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The purpose of this thesis was to investigate various 
factors affecting the academic performance of Naval ОЁ ісег 
Students in the Operations Analysis Curriculum at the Naval 
Postgraduate School. The original goal was to arrive ata 
predictive model which would improve the present selection 
process and possibly reduce the numbers oz student academic 
transfers out of the Operations Analysis Curriculum. These 
transfers have historically been about 10X or the original 
class. Due to the relatively small sample size (159), it 
was not possible to cross validate . Because of this the 
results are not presented as a predictive model. The 
utility of the study is rather іп its analysis or those 
factcrs intluencing the student's academic performance; the 
resultant promotion of understanding, and suggestions for 
further study of the subject. 

The pertinent variables that were readily available and 
are in this study are college ОРЕ, college degree, the 
Officer's designator, college quality rating, elapsed time 
from cogzpleticn of college to starting the Operations 
Analysis Curriculum, year graduated zrom the CA Curriculum, 
and the length of refresher attended at the Naval 
Postgraduate School. Current practice using only the "АРС" 
codes as a predictor achieves a multiple correlation coeffi- 
cient of .21 when run through the ANOVA package. Тһе model 
recommended in the study has an R2 of .41 while another 
model achieves an R@ as high as .53. 

The study subjects include approximately one-halt of the 
Navy CÀ graduates  rrom the period 1974 to 1985. This was 
the case sirce APC's were only available for about one-half 


of the graduates. The study includes only those students 


with academic profile codes of 435 or better. Ike recom- 
mended APC for the Operations Analysis Curriculum is 324 or 
better. There were 43 individuals includec in the study 
whose APC was ,at least in one of the three digits, outside 
that recommended for ОА. Cf these 43 people, 6 went 
straight into the curriculum without any refresher. 

A review of the literature reveals a thesis written by 
Heru Soetrisno in 1975 titled "Prediction of Academic 
Performance of the U. 58 Navy Officer Students in the 
Operations kesearch/Systems Analysis curriculum at the Naval 
Postgraduate School" [Bef. 1]. The study was a regression 
analysis using biographical data, a personal interest survey 
and the graduate record examination. It covered all tne 
Navy students in OA in the Spring of 1974 (72 students). 
The thesis concluded that the three above mentioned vari- 
ables and combinations of them were better predictors of 
student performance than undergraduate QPR and college 
quality. 

Numerous articles have alsc been written concerning the 
subject of predicting academic performance. A review of 
many ot these articles has left the author with the impres- 
sion that it is clearly not a clean-cut issue aS to what 
test cr measure is the best in predicting academic perform- 
ance. However of all the choices, it is recognized that 
prior academic performance and aptitude tests are generally 
considered to the most important predictors of future 
academic performance [Ref. 2: page 101. 

The study opens with the development of the academic 
profile code anda review or the data. Ihe analysis 15 
conducted by first a preliminary look at the independent 
variaLles in relationship to the dependent variable and then 
with an analysis of variance technique. Тһе study ends with 
several conclusions and recommendations РОБ future 


consideration. 
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The Navy Military Personnel Command (NMPC) 1s respon- 
sible for filling quotas at the Naval  Posgraduate School. 
The current procedure is to convene annually a Graduate 
Selection Board [Ref. 3]. This board meets and reviews 
those ‘Officer's records who are potentially eligible for 
graduate education as shown in enclosure four of [Bef. 3]. 
The bcard bases their determination for possible graduate 
education on the Officer's professional performance and 
their academic ability as evidenced py their academic 
profile code (APC) [ Ref. 4]. The most recent board screened 
13,000 records and selected 4,000 for possible graduate 
studies. Approximately 90% of those students eventually 
compieting fully funded graduate studies will receive their 
degrees from the Naval Postgraduate School [Ref. 5: page 
25 ]- 

The APC is a three digit code summarizing the previous 
education of each Officer and is calculated as seen in 
Figure 2.195 

Appendix B is a sample academic record evaluation (ARE) 
Sheet. The ARE is used by the director of admissions at the 
Naval Postgraduate School aS a worksheet to compute an APC 
ror every newly designated Naval Officer each year. The ARE 
is filed and maintained at the Director of Admission's 
office at the Naval Postgraduate School and is kept on fale 
until the Officer has been designated as a subspecialist or 
has keen determined not suitable for graduate education. 
NMPC annualiy directs the Naval Postgraduate School to 
remove and destroy the АБЕ = for those above mentioned 


Officers. 


12 





OPR CODE 

(1st APC Digit) 

(Code # Grade QPR 
0 А-/А 3.60 

1 В+ 3.20 

2 8-/8 2. 60 

3 C+ 2.20 

4 С 1.90 

5 Below С 0.00 


[Repeated courses and failures 
| аге included in the QPR calcu- 


lation.) 


— — '—  —À — —— o у = Cue d uo MER m me 
` 


Ranqe 


- 4.00 


' 
— N N UW C9 
е ° • 
л 
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Code f 


0 


TECHNICAL CODE 
(3rd АРС Diqit) 


Code # Physics (Calculus-Based) 


O er -> R+ average 
1 -------------------------- -------------- -> C+ averaqe 
2 Complete sequence taken with 

B+ averaqe 
3 Comolete sequence taken with 

C+ averaqe 
4 At least one course with 

C grade 
5 None 


MATH CONE 
(2na АРС Ninit) 


Calculus-Related Math Courses 





Siqnificant post-calculus math with 
B averaqe 


Two or more calculus courses with 
В+ averaqe 


Two or more calculus courses with 
C+ average 


One calculus course with 
C grade or better 


Two or more pre-calculus courses with 
B average or better 


At least one pre-calculus course with 
C qrade 


No colleqe-level math with С aqrade 


Siqnificant Upper-Division Course 
Coverage in a Pertinent Fnaineering 
or Physical Science Discipline 


i 
————— ————————————————— E E I U ene pte e a T a a a al a ЕОС IT 


S... | 


Figure 2.1 


Calculating APC's. 
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The APC is originally based on the individual's college 
performance and rarely changes unless the individual corre- 
sponds with tne Director of Admissions at tne Naval 
Postgraduate School and petitions to raise (improve) his APC 
with written proof of additional accredited academic 
achievement [ Ref. 4: раде 11). 

A Naval Officer must possess an APC of 324 or better 
(€. ge 112) to directly enter the Operations Analysis 
Curriculum [Ref. 5: page 32]. Additionally, a Naval O£ficer 
may enter the OA Curriculum with an APC of 344 after 
completing one or two guarters of the Engineering Science 
Curriculum. The Engineering Science Curriculum is designed 
to provide an opportunity for Cfricers with inadequate math- 
ematical and physical science backgrounds to establish a 
good math foundation to be able to qualify for a technical 
curriculum (Ref. 5: page 36]. There is also a six week 
refresher available that is designed to rapidly cover the 
calculus and physics fundamentals for those Otficers who are 
direct inputs into the OA curriculum without any quarters of 
Engineering Science. Exceptions are made and it is possible 
for an incividual to enter the OA curriculum without the 
minimum APC. It is also possible for an Otficer to start OA 
without any refresher at allas did 63 of the study 
subjects. 

The OA curriculum is of a technical nature and students 
With solid college performance and technical majors are 
encouraged to enroll in it. However, there are some very 
good professional Officers who do not have the required 
academic background to directly enroll in OA. The Navy 
would like some of these Officers to be able to attend NPS 
арта technical сотен In response to tnis need, the 
Navy bas recently introduced (1985) tne Technical Transition 
Program (TTP). This program is designed to allow  tnose 


proressionally exceptional Cfficers witk weak college 
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backgrounds to enter a technical curriculum via a one or two 
quarter individually tailored preparation program. This 
program is slightly different from the Engineering Science 
curriculum in that it is individually structured to meet 
each student's needs while it also varies from different 
curriculum to curriculum. This program not only provides an 
opportunity to Officers that at one time had no or little 
hope cf attending the Naval Postgraduate School but it also 
provides more graduate trained subspecialists for the Navy. 
The college records or these candidates for the TTP are 
screened at the Naval Postgraduate School and a deciSion is 
made whether or not to allow an individual to start the 
program in hopes of eventually entering a technical curric- 
ulum. This study reveals several important factors and 
considerations in order to help the decision maker better 
access the potential academic performance of future OA 


students. 


III. DISCUSSION OF THE DATA 

The study data was gathered from several sources 
including the Office of the Registrar, Director ОЕ 
Admissions, the Operations Analysis Curricular office at the 
Naval Postgraduate School and from the Naval Military 
Personnel Command. Most of the data was obtained from the 
individuai student files maintained by the Operations 
Analysis curriculum secretary. These files contained much 
of the student data such aS University attended and what 
dates attended, college degree, designator and length of 
refresher attended at the Naval Postgraduate school. These 
same files contain the student's grade sheet summary of all 
course work completed at the Naval Postgradute School. From 
this sheet, the dependent variable in the study was calcu- 
lated. Four different quality point ratings (QPR) were 
studied. Тһе first was the student's total grade average 
after four quarters of the Operations Analysis Curriculum. 
This grade is of special importance as it 1S at this point 
in the curriculum that a final decision must be made as to 
continue a marginally performing student in nopes that nis 
overall grade point average will improve ог to allow him to 
possibly transrer to another curriculum with enough time 
remaining to successfully complete that program. It is also 
important to note that through the first four guarters each 
option is essentialiy the same. Hence, there is uniformity 
in the program. If a model cculd be constructed that would 
improve the present selection process and reduce the numbers 
of these transfers, a savings in time and money соціа Бе 
realized by the Navy. 

Tbe three other  deperdent variables looked at were the 


Student's quality point rating after six quarters (when most 
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or the stringent course requirements are finisned), his 
graduate qpr after eight quarters and also the total overall 
quality point rating after eight quarters which completes 
the degree. All these qpr's were determined by dividing the 
weighted total of the grade points earned by the total hours 
attempted for the respective quarter totals. None of these 
qpr's included any grades earned during refresher courses. 

The academic profile codes were the most difficult data 
points to obtain. Although the Director of Admissions main- 
tains a conputer printout of all current APC's, very few of 
tne study subjects were still on the listing. Of the 343 
Navy CA students completing the Operations Analysis curric- 
ulum at the Naval Pcstgraduate School from 1974 to 1985, 
only 80 ОЕ them had APC's in the printout, in their files or 
in their academic record evaluation sheets. The additional 
APC's were obtained from the Officer's data card sent to the 
Naval Postgraduate School by NMPC. A total of 172 APC's 
were obtained. Of these 172 APC's, 159 were used in the 
study. The thirteen individuals removed rrom the study were 
in very low populated levels of several of the variables. 
The variables for the academic profile codes are seen in 
Egure 3.1 . 

The 159 Naval Officer study subjects all graduated with 
Master Degrees in Operations Analysis. Although aot a 
random sample, they were treated as a randoa saaple for the 
Purpose of the study. There was no apparent grouping or 
Special distribution of the study subjects compared to the 
entire population of 343. The data were tabulated into an 
159 by 18 matrix and is included as Appendix C. 

The variable college rating was obtained from the 
Gourman Report [{ Ref. 63 раде 7). This repcrt evaluated 
1,845 colleges and universities in terms or tne institu- 
tion's objectives, curriculum, faculty, faculty research and 


honors, administration, library, budget, resources, student 
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2722022, 034% 
АРСІ = College QPR 


code main effect level # of data points 

| 0 1 8 

1 2 28 

2 3 79 

3 4 39 

4 5 5 

total 159 

APC2 = Math Code 

code main effect level # of data рото 

0 1 24 

1 2 29 

2 3 76 

3 4 30 

total 159 


APC3 = Technical Code 


code main effect level # of data points 
0 | 4 
1 2 19 
2 3 25 
3 4 FI 
4 5 39 
5 6 13 
total 159 


Ln acci diis qu. men dapes GNE RED iram —- ere Oe r———Tr—————À—— ce Gee, = Ge ee OS es ee ee OS ee a 
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Flgure 3.1 APC Main Effects. 


scores on standardized tests, admission policy, ard several 


other ractors. Tne range for the college rating variable as 
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a cofactor was 4.99 for the highest rated institution down 
to a rating of 2.01 for the lowest. This variable was also 
looked at as a possible main effect and was divided into 


categories as seen in Figure 3.2. 


| rating range level # of data bienes | 
I aX 

B 

| strong 4.41-4.99 6 34 

| good 4.01-4.40 5 85 | 
| acceptable 3.51-3.99 + 18 | 
| adequate 3.01-3.50 3 19 | 
| marginal 2.01-2.99 2 3 i 
i | 
| с. | 
| total 159 
L 4 


Figure 3.2 College Rating. 


Тһе variakle college degree is seen in Figure 3.3 . The 
grouping Naval Science was reguired due to the twelve 
Students included in the study who graduatea from the Naval 
Academy prior to 1973. Prior to that тіше orly one aegree 
was ccnfirmed by the institution and although the midshipmen 
took a variety of courses, many of wnich were of an engi- 
neering nature, they received a B.S. uegree in Naval 
Science. 

The variable refresher was investigated aS both a main 
effect (yes=attended cr no=did not attend) and aS a cofactor 
listing the length, in quarters, of refresher taken at the 
Naval Postgraduate School. There is a six week rerresner 
Гог each class prior to Starting the curricuium. 
Additionally, a student may possibly receive one or two 
quarters or refresher depending on several factors. These 


quarters of refresner are gererally undertaken by students 


та 


| 


total 159 


| Degree level # of data points 

EM | 
| Business 1 14 | 
| Engineering 2 31 | 
| Humanities 3 4 | 
| Math 4 59 | 
| Social Science 5 16 | 
| Naval Science 6 12 | 
| Operations Analysis 7 23 | 
| j 


| 





Figure 3.3 College Degree. 


not  zeeting the minimum recommended APC for OA or Гог 
students who have not been in aL academic environment for a 
long reriod of tine. The decision is generally made at the 
Curricular Officer and Academic Associate's concurrence and 
with apfroval from the student's detailer. There ls nothing 
concrete aoout this process anrd it is possible to start the 
Curriculum directly without any refresher. The cofactor 
length of refresher waS grouped aS Seen in Figure 3.4. 

The variable designator was viewed aS a main effect. 
Zach Naval Officer has one designator which is generally 
assigned after completing a school or training course. They 
retain this designator for their entire length of service 
with the few exceptions of individuals transfering to 
another specialty and hence changing designators. The 
designators of tne study group can be seen in Figure 3.5. 

Table I is a summary listing of all tne variables ana 


their levels that were investigated in the study. 
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total 159 


| quarters of Refresher level # of data points 
| 0 1 63 
55 2 58 
| : è 
| 4 30 
| 


—————— ———— ———— а) 


Figure 3.4 Length of Refresher. 


oos occ; IL ,-- —————————— — 
| designator definition level # of data pts. | 
| | 
| 110х restricted line 1 6 | 
| 111х unrestricted line 2 50 | 
| ШІ/2х submarines 3 10 | 
| 131x aviator 4 41 
| 132х naval flight officer 5 26 | 
| 140х engineering duty 6 1 | 
| 161х intelligence 7 3 ! 
| 310х supply 8 20 | 
| 113х Special warfare 3 2 | 
| cotal 159 i 

4 


Figure 3.5 Designator. 
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TABLE I 
EXPLANATION OF THE STUDY'S VARIABLES 


Cofactors Values 
time since college in months 23-178 
college rating 2.01-4.99 
year graduated from NPS 74-85 
length of refresher (quarters) 0, 25 mE 
Main, Effects Level 
АРСІ college арг = 12.55 
APC2 math code * 1,2, 94 
APC3 technical code * 1,2,3,4 578 
College Degree Level 
Business 1 
Engineering 2 
Humanities 3 
Natural Science (Math) 4 
Social Science Э 
Naval Science 6 
Operations Analysis 7 
Designator Level 


110x Restricted line 

lllx Unrestricted line 

112x Submarines 

151x Aviator 

132x Naval flight no ic ox 
140x Engineering Duty officer 
161х Intelligence ‘oftrcen 


310x Supply officen 


о Со ~ O tn M о [э ҥе 


113х 5реста! Маггате re 


° Coded as АРС + 1 for computerepde d а 
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IV. PRELIMINARY ANALYSIS OF THE DATA 
A preliminary analysis of the data was conducted using 
APL and Grarstat capabilities of the IBM 370 located at the 
Naval Postgraduate School. Each variable was investigated 
in relation to tne dependent variable "4th quarter арг". 
All cemacks of significant differences are a result of a 


formal "t" test with a .05 level of significance. 


A. 4TH QUAKTEB QPR VERSUS APCÍ 


The first АРС digit representing the individual's 
overall college qpr was plotted against his  acadenic 


pecformance in the OA curriculum through the fourth guarter. 
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Figure 4.1 ЦЬ ОТЕ ОРЕ #5 АРСА. 
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Figure 4.1 is a graphical representation of the statistical 


relationsnip while the results are tabulated in Table II. 


TABLE II 
üth ОТЕ ОРЕ VS APC1 


CATEG NO: PTS Wars s Y-MEAN Y-DVN 25 50 5 
ALL > T59 MESI 35512. “9755010 3.12 3236 3189 
0 8 ` 0.050314 m 7° 0.24068 3.43 3.625 09998 
1 ВО 325386 “C227 eZ 3.36 3.4/ БЕБЕ 
Z 79 0.49686 3.3448 0.3088 3.09 3.34 1 
3 39 770224528: 352826 0220030 3.07 3.25999 
4 > 0.05144; 3.042 0.34672 3.02 за 


These results show the student's performance in college has 
a direct and logical relationship to his performance through 
the fcurth quarter of the OA curriculua. The higher one's 
college qpr tne better one's ferformance in OA. Ihe study 
group's average APC for the first digit is very ciose to two 
while tne overall grand mean for their fourth jJuarter srade 
vas 5.376 The highest code of zero had a signiricant 


difrerernce compared to tne overall mean. 


В. 41TH QUARTER QPR VERSUS APC2 


The second APC Gigit representing the student's under- 
graduate calculus proficiency was piotted against his 4th 
quarter qpr. Figure 4.2 is a represertation of this rela- 
tionship and the numerical results аге tabulated in Takle 
II. There is a signiricant difference among tne first two 
devels of this variable and the overall near. Ihe recon- 
mended APC for 2A іп math is three or better while four 1s 
acceptable via the engineering science curriculun. The 
study group's average was 1.7 while the entire group had a 


Math APC or three or better. Т.е overall relationsaip is 
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just a sligat positive one where the lower (better) one's 


math code translates to a higher 4th quarter grade. 


C. 41H QUARTEB QPR VERSUS APC3 
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Figure 4.2 4th QTR QPB VS APC2. 


The third APC digit representing the student's technical 
code waS similary studied and is shown Figure 4.3 and Table 
IV. This relationship does nct show a iogical progression 
of high 4th quarter performance with the better technicai 
codes. It in tact jumps back and forth with no apparent 
magic. Admission to the OA curriculum nay reflect sone 
compensating feature. 

The iast level (those students with an APC3 code of 
five) orf thirteen individuals had the second test average 


gpre “nese thirteen subjects were looked at individually to 


TABLE III 
4TH QTR QPB VS APC2 


CATEG NO. PTS ETS Y-MEAN Y~-DVN 25 50 73 

ALL Tc 11. 3.97 39 OTO SINE 3.12 3226 3455 
0 24 - 0.15092 3.4963 0.26836 3.29 3743 524 
1 29 0.182255 ие 3.29 35 5 ВВ 
2 716 0.47799 TR 143 Oe ety 3.09 XE 3.49 
3 30 0-058869 — 9:290 30260007 3.03 3.2 88 5 
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Figure 4.3 4th CTR QPR VS APC3. 


try to determine a possible reason for this. It was discov- 
ered, that as a group, their average first digit APC for 
thelr college performance was 1.4. “his is much Ebetter than 
the entire study group's average of 2.1. TLe only difrer- 


ences between the six level means апа the overall mean that 
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TABLE IV 
4TH ОТЕ ОРЕ WS APC3 


CATEG NO.PTS %-РТЅ Y-MEAN Y-DVN Жоо» 
о 
Кел. 159 1 3.373 0.33011 3.12 3.36 3.64 
| 0 п 15 3-705 0.17642 3.5 3.59 3.77 

1 19 0.1195 3.4511 0.33468 3.05 3.46 3.79 
| 2 25 0.15723 3.3636 0.29094 3.1 3.29 3.6 
3 59 0.37107 3.3958 0.29821 3.16 3.36 3.63 

4 39 0.24528 3.2379 0.3671 3.96 3.26 3.46 

5 13 0.081761 3.4769 0.27921 3.29 3.46 3.73 


were statistically significant were the first level zero and 


the next to last level four. 


D. 4TH QUARTER QPR VERSUS COLLEGE DEGREE 


Ccllege degree was the next variable plotted against the 
4th guarter арг. Figure 4.4 graphically presents and Table 
V lists this data. 

Althougn none of the differences are statistically 
Significant, the business, engineering, math and operations 
analysis majors performed above the mean of the study 
sample. If one disregards an outlier or two within the OA 
level, OA would have shown a greater positive difference 
rrom the grand mean and this can be seen in its inter- 
quartile range. The data shows an intuitively logical 
assumption that students with a social Science or humanities 
undergraduate degree would do less well in a technical 
curriculum when compared to students with a more guantita- 
tive college degree such as engineering or mathematics. The 
performance of those people with naval science majors is 
relatively low. This may be a result of several confounding 


factors not readily apparent. 
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Figure 4.4 4th QTR QPR WS College Degree. 


TABLE V 
4TH QTR QPR VS COLLEGE DEGREE 


CATEG. NO. PTS C 25 DIS Y-MEAN Y-DVN 125 250) „= 
ALL Із Әді 3.373 0, 3.12 3-36, я 
BUS INESS 14 0.08805 3.465750. 50 3.31 3.45 EI 
ENGINEERING 31 0.19497 342410. 2 T 3.11 3.41 4 НА 
HUMANITIES 4 0.025157 3.2475 0.3447 2.93 3.11 АК 
МАТН оО СО ШИ 324037 ВЕЗЕ 3.17 3539 ees 
SOCIAL SCI 16. 0798655 3.253069 0. 2 3 3.16 325 
NAVAL SCI 12 0.075472 5 065500052 08 2.09. 3 ЕЕ 
23 0.14465 3.9822. 1053 3920 3.26 730 ЕК 


Е. 4TH QUARTER QPK VERSUS DESIGNATOR 


The student's designator was the next variable plotted 
against 4th quarter арг. Disregarding the very small levels 


or 1400, 1610, and 1130 from the discussion, leaves only 


1120 (submariners), 1320 (naval flight officers) апа 3100 
(supply) designators that did better than the grand mean. 
This can be seen іп Figure 54.5 and Table VI. A test of 
sigaificance showed only the 1120 and 3100 designators 
performed better and the 1100 deSignator performed worse 


than the overall mean. 
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Figure 4.5 4th QTR QPR WS Designator. 


Е. 4TH QUARTER QPR VERSUS LENGTH OF REFRESHER 


The variable length of refresSsner was plottec against 4th 
quarter gpr as seen in Figure 4.6 and TaLle VII. 

It can be seen that those individuals who do not attend 
refresher do slightly better than tne students that attend 
refresher, This could mean tnat a good job is done identi- 


fying those individuals who need rerresner. It is also 
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TABLE VI 
4TH CTR QPR WS DESIGNATOR 





CATEG NO. PTS s PIS Y-MEAN  Y-DVN 25 50 155 
ALL o 1 J. 375 0.330181 3.12 3.36 2 
1100 6 0.037736 2315517880 50 3.07 3.34 УЕ 
1110 50 ОСЗ 3.2456 2314980 3.04 3.19 3.4 
1120 10 0.062893 3.654 02 92852 3.35 3.82 923980 
1510 41 0.25786 3.341 0.23245 3.15 3.37 325 
1320 26 0.1635 3.4588 ОБ Аја 3.26 3.46 3:15 
1400 1 0.006259 39729 0 3.29 3.29 228 
1610 3 0018868 345397001055 Эй 3.39 37 
3100, 20 0312379 237993 07339289 3.25 3 6977 
1130 2 07012579 m08 0.26 2.62 262 | | 
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Pigure 4.6 uth QTR QPR VS Length of Refresher. 


possible that the students tnemSeives nave an intluence in 
waether or not they attend refresher. It couid also be tnat 
those students tnat have a very confident opinion of their 
academic background may be deliberately deciding rot to 


report until well after rerresher starts. This sort Ton 
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TABLE VII 
GTH QTR QPR VS LENGTH OF REFRESHER 


CATEG. NO. PTS %-РТ5 Y-MEAN Y-DVN 229 . 90 579 

ALL So a РАНО 0.33011 Ооо ШШ 64 
0 63 0.39623 3.441 0.33443 о она on! 
0.5 ӘӘ ФЕ 522597 0.32014 3; 12 05-6 
l 8 0.050314 3.54 0729039 За 3-73 
2 ЗОН ЕВЕ 5.2117 0.28024 У Оне он 45 


biased selection could be affecting the results of this 
variable. The result of tke stuüents with one quarter of 
refresner doing better than the mean could also be artiri- 
сіа1. Once they demonstrated that even though they fit the 
categcry of individuals who should get refresher, they 
really could handle the pace without it then they could be 
set back into their original class with a few scheduling 
arrangements made. There is also no permanent incentive to 
do well in the 460 curriculum since the grades do not count 
and are not reflected in the student's total grade average. 
The formal test of significance showed that опу the 
Students with two quarters of refresher performed at а 


Statistically lower level than the overall grand mean. 


С. 4TH CUARTER QPR VERSUS COLLEGE RATING 


The variable college rating was the next variable 


plotted against 4th guarter gpr and 1S Shown in Figure 4.7 


and Table VIII. Ihe data does not show a significant 
difference among any of ihe coliege ratings. Disregard tne 
lowest rating as it only contains three individuals. The 


remaining four categcries shcw a slight decrease in 4th 
quarter gpr as the rating decreases but it ıs not statisti- 


cally significant. 
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TABLE VIII 
4TH QUARTER QPB VERSUS COLLEGE RATING 


CATEG. NO PTS SEIS Y-MEAN Y-DVN 225 450 ЖЕ 

ALL Dod 34373 0/55 DNI 3.12 3.3001 
2.022599 3. 00.018868 3.32967 0.251 3.16 3.2744 
3.02375 199 304095 3.4005. 022085 3.0/ 3.43 34 
oO о! ВСЕ 0.28746 3.12 3,28 ЖЕ 
4.0-4.4 85 0.53459 3.3554 022585 3.11 35558 s 
4.41-4.99 34 0.21384 3,4397 305590297 3.12. 374 | ован 


He 41H QUARTER QPR VERSUS YEAR GRADUATED FROM NPS 


The variable year graduated from NPS was piotted agairst 
üGtL quarter qpr and is seen in Figure 4.8 and Table IX. Тһе 
data is seen to be heavily concentrated in the three most 
recent years (846 of all Study subjects). The years 74 and 


75 showed a statistically significant mean that was Deiow 
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the overall mean of 3.37. The year 1980 was the anly year 
that was significantly above the overall average. This 
could possibly reflect the “luck of the draw" as difrerent 
student sections progress through the curriculum with 


different combinations of professors and grading practices. 
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Figure 4.8 4th CTR QPR WS Year Graduated from NPS. 


I. 4TH QUARTER QPR VERSOS TIME SINCE COLLEGE 


The variable time since college was plotted against the 
4th quarter qpr as seen in Figure 4.9 and Table X. 
After discarding the first level with orly two observations, 
it is or interest to note the very slight improvement in gpr 
as tire since college increases. Once again the differences 
between the overall mean and the individual level means are 


not significant in a formal test o£ significance. Tne 
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TABLE IX 
4TH QUARTER QPR VERSUS YEAR GRADUATED FRON NPS 
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Figure 4.9 


tris variabile 1S 


constant performance over 


relative 
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logically expect реггоглш Ее 


would 


Surprising as one 


degraded as the time since completing college and commencing 


another academic situation ircreases. 
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TABLE I 
4TH QUARTEB ОРЕ VERSUS TIME SINCE COLLEGE 


CATEG NO. PTS 5-5 Y-MEAN Y-DVN 25 50 75 
ALL 13951 55 9050898055 3OTT 3:12 9999959 3.64 
0-36 С ОЛО 1191 73,595 0.165 59499 3.43 3.76 
тосо 58 0.361/8 3.3 [gne 2.1 | 2023277 
61-84 ЭВ 2159 Ap 0. 4037 0.34813 В 9m 3.067 
35- |08 ДИ ЧИ О ЈА 3.56 0.35614 О ОР 54 
ПОРЕ: 32 Э ио ред 1622 0529108 Bed 3.48 3.76 
МОВ ОБ IO d; 5.436 0.31117 Dm2 s 79 


У 


The preceeding relationships were  iooked at to investi- 
gate the basic properties of the variables studied and not 
to draw conclusions on these results. It would be incorrect 
to draw the conclusion that these one to one confarisons 
imply any airect cause and effect without studying the 
interactions of ali the variables concerned. Chapter V wili 
investigate these relationsnips with an analysis of variance 
approacn. Appendix D contains the same figures and tables 
for the other three dependent variables (6th quarter grad- 
uate орг, 8th quarter graduate total qpr and Әйіп quarter 
potal агг) - 
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V. RESULTS OF THE ANALYSIS 


m ee eee === = <= m = == == “m= = “am шш» hq 


А. APPROACH OF THE ANALYSIS 


This chapter describes the analysis techniques used and the 
results from the analysis. The analysis of the data was 
conducted with the aid of the Naval Postgraduate School's 
IBM 370 computer using an "ANOVA" package designed ру 
Professor Russell Richards of the Naval Postgraduate School. 

The "ANOVA" package is capable of performing multiple 
linear regression on unbalanced data. It 1s an APL progran 
with many and varied outputs. Appendix E is an explanation 
of the "ANOVA" program, its capabilities and required input 
data format. The program uses the least squares approach 
and calculations are done ib matrix format. 

All of the 159 students that comprised the population of 
this study were included in the anaiysis to develop a model 
for pcssible prediction of student performance. À cross 
validation procedure, using a portion of the data, would 
have keen a useful technique to check the validity of the 
results. This procedure was not employed due to the iinited 
numnper of academic prcfile codes tnat were available for the 


study- 


Be MULTIPLE LINEAR REGRESSION ANALYSIS 


Multiple linear regression techniques were employed 
using the "ANOVA" Prcgram to develop the explanatory vari- 
ables to be included in the model and then to estimate the 
coefficients describing the weights to assign to the 


variaLlles. 
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С. MCDEL 


The model used is of the matrix form: 
Y = XB же (eqn 5.1) 


where, Y is a vector of dependent variables 
X is a matrix of independent variables 
Bis a vector of coefficients 

e is a vector of error terms. 

In ANOVA applications of linear models, the qualitative 
(nain and interaction) effects are estimated on an interval 
scale and have arbitrary origins. Hence the matrix Х 15 
singular. The "ANOVA" package (Professor Richards) solution 
Manages this Problem by deletion of selected columns and 
these selected columns are listed for the user. A selected 
column represents an omitted variable whose estimated coef- 
ficient is the negative of the total of all other variables 


in its category. 


D. ASSUMPTIONS FOR LINEAR REGRESSION 


While using the linear regression approach, a number of 
assumptions must be made concerning the error terms. The 
errors must be independent, have zero mean, constant vari- 
ance and must be normally distributed [ Ref. 7]. Each time 
the "ANOVA" program was run on а different version of the 
model the residuals were plotted to verify these  assump- 
tions. Figure 5.1, Figure 5.2 and Figure 5.3 display these 
results for the particular model that will later be devel- 
oped as the study model of choice. These figures ana the 
discussion in the following paragraph show the assumptions 
are adequately met. 

The variables included in the model must also be inde- 


pendent. The Pearsoa's product moment correlation 
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Figure 5.1 plots of Residuals from the Study Model of Choice. 
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NORMAL PROBABILITY PLOT 
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MINIMUM ° -.559 


МАХ па M , ‚629 
CENSORING : НОЕ 
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SKEWNESS: 1.8156Е71 0.000060 М) 0.00040351 Q 
KURTOSIS: 2.5596E0 3.000060 SIGMA 0 0 00020303 
PERCENTILES SAMPLE FITTED GOCOHESS OF FIT 
5: -0.37345 -4.1804£-1 CHI-SQUARE : 2.8303 
10: -0.31989 -j.256808F-1 DEG FREED: 5 
25: 70.18835 _ =).713167) SIGNIF ; 0.72474 
50; 70.0083107 2.5665E^8 KOLM- MIRN ; 0.044604 
75; 0.18291 1.2131£71 SIGNIF 0.90973 
90: 0.35343 3.25688-1 CRAMER-V M : 0.021326 
95: 0.48034 4.1804Е71 SIGNIF > .15 
0 
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Figure 5.2 Residual Plot and Data :Study Model. 
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Figure 5.3 Scatter Plot of Residuals :Study Model. 


coefficient (г) was calculated ror tne entire data matrix. 
Table XI is the results of these calculations. Several of 
toe variables were looked at as both tain effects qualita- 
tive) and, after a transformation of the data, as cofactors 
(quantitative). In these cases of correlation between two 
scales of the same variable, a high r will be calculated. 
In all other possible correlations, the r value 15 low 
enough to be able to assume independence between the vari- 
ables of the study. 

The serial autocorrelation statistic was used to verify 
that the error terms were independent. Tnis statistic is 
provided by the output menu of the "ANOVA" program. For the 


error terms to Le considered independent, the serial 


4 0 


TABLE II 
CORRELATION BETWEEN THE STUDY VARIABLES 


| Column/Row Title 
1 АРС1 
2 АРС2 
3 APC3 
4 4th Qtr Qpr 
5 6th Qtr Opr 
6 8thn Otr Opr 
7 8th Otr Total Opr 
8 College Degree 
9 Designator 
10 Time Since College 
LI Refresher (Yes: or no) 
12 College Rating (Gourman scale) 
Es Year Graduated NPS 
ПИ ИН 9599 -.36099-—.360 99259 102028 EO 16 121 = | 
1 К ОШОО -18 59080 -.22 —.09 -.11 Suo cO 
1 E 4 =. ]5 716 - .07 . 06 EE IS" -.2] E 
1 91 9] 96 -.14 521 12 17 06 т 
1 97 ЭЗЕ Т ОО ІШ 20 08 18 
| 1 ЭЗ —„‚11 23 T 21 09 16 
| 1 x 23 T 18 09 16 
1 в 10 209 00 03 
1 27 2108 Об = 206 
MEL Lm Omen 20 
1 UO = 05 
1 2202 
1 
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autocorrelation statistic should be equal to Zzero [ВеЕ. | 
page 450]. For the model of choice, this Statistic was 
egual to .06 and hence the error terms are considered to be 
independent. 

A total of forty different models were analyzed by the 
"MANOVA" package. The four covariance models of aighest 
interest will be discussed individually. While these four 
models use the fourth guarter qpr as the dependent variable, 
each of the other three дрс'5 were analyzed as the dependent 
variabie also. The results of those analyses were not 


Significantly different [rom the 4th quarter models. 


E. THE TWO COFACTOR AND SIX MAIN EFFECTS MODEL WITH 
INTERACTIONS 


This model used time since college and college rating as 
coractors and the three academic profile codes, college 
degree, refresher (yes or no) and year graduated from NPS as 
main effects. The model included the interactions between 
APC1 and APC2, APC1 and college degree, and college degree 
and refresher (yes or no). Table XII is the ANOVA table 
from the "ANOVA" program. 

The coefficient of multiple determination (R?) ot .532 
is the highest of any of the models analyzed in the study. 
Thus this model is able to explain 53% of the variability in 
fourth quarter OA grades by Navy students. The model is 
relatively signiricant (.006) but only the one variabie, 
time since college, is individually Signiricant above the 
.05 level (.029). None of the interactions show any signif- 
icance. Тһе covariance model is shown in Figure 5.4 . 

Table XIII is a listing of the peta coefficients 
provided as an output from the "ANOVA" progran. It is 
interesting to note that the coefficient for time since 


college is positive. 
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TABLE III 
ANOVA TABLE 


R-SQUARE = .53 SERIAL AUTOCORRELATION = -.019 

SOURCE OF VARIATION БЕ 55 М5 E SIG 
TOTAL 158 17.3 „109 
ERROR 96 del . 08 
MODEL 62 Diaz 15 Ib 006 
Xl] TIME SINCE COLLEGE 1 41 . 41 4.88 7079 
X2 COLLEGE RATING 1 ЇН] E 1.30 229 
FACTOR l APCI 3 29 207 86 . 492 
FACTOR 2 АРС2 3 08 203 E „818 
FACTOR 3 APC3 5 34 107 82 2939 
БӘСТОВ 4 COL. DEGREE 6 83 „14 1569 „147 
FAC | 1 07 107 83 ‚ 366 
FACTOR 6 YR GRAD NPS 11 83 203 259 ‚249 
INTERACTION 1 X 2 2 86 10 1.14 . 345 
INTERACTION 1 X 4 16 1742 <08 95 25180 
INTERACTION 4 X 5 5 38 08 90 ‚485 


| 


N: - В» t В Ху т Bz Xia + 3х3 + Ps X¿ q + В; Х 5 
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Figure 5.4 Two Cofactor and Six M/E Model vith Interactions. 


Е. THE TWO COFACTOR : SIX MAIN EFFECTS MODEL WITHOUT 
INTERACTIONS 


This model ls the same as the previous section's model, 
however, the insignificart interactions were not included. 
Table XIV 1S the ANOVA table from the "ANOVA" program. 

The coefficient of multiple determination (R3) has 
decreased to .373 but the significance of tire model has 


improved abit to .0004. Now both time since college 
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TABLE ХІІІ 
COEFFICIENTS 


BETA COEFFICIEDBUES 


. 025 Time Since College 
5.01 TES: College Rating 
5 642 
АРС1 APC Code 
. 203 APCO 
-.068 APCI 
-.134 APC2 
-.142 APC3 
EE АРС4 
АРС2 
. 038 APC0 
. 054 АРС1 
-.046 APC2 
-.046 APC3 
APC3 
. 019 АРСО 
= 010 АРС1 
-.060 APC2 
“=> APC3 
-.078 APC4 
· 084 АРС5 
COLLEGE DEGREE 
. 509 Business 
= [029 Engineering 
-239 Humanities 
-.017 Math 
-.295 Social Science 
-.340 Naval Science 
LTA Operations Analysis 
-.116 Refresner Yes 
STEG Rerresner No 
VEAR 


NM NES 


| 
о 
мо МО КО СО Олл 


NTERACTIONS 


мин Момо 
ЪФ УМ 14200-00 РО ДАМО ОЈОО ДОСО Оно) 


СОВА о О 
LI UW UW MONN 2 ааа 


осоо оао 
ROR Whe La Re 
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TABLESXIII 
BETA COEFFICIENTS (cont'd.)} 





NUMBER (2): 
LEVEL(1): -1.332 1х] 
LEVEL(2): -.660 JX 2 
LEVEL (3); -.688 L x 3 
БЕІН; : -.043 1Х4 
LEVEL(5): EU» MEVS 
REUS : -.114 1 X 6 
LEVEL (7): F013 pax | 
LEVEL(8): 77 2X3 
LEVEL(9): 8122 pax 4 
ГЕМЕ (10): „067 2 Х 5 
LEVEL(11): -.155 ха 
LEVEL(12): -.085 3X3 
ME : .156 3X6 
LEVEL(14): „113 4х1 
Е : . 311 4X4 
LEVEL(16): „340 ДХ 5 
NUMBER (3): 4 X 5 INTERACTION 
mil : .192 Ix] 
LEVEL(2): .134 Pex 1 
LEVEL (3): -.591 Bux 
LEVEL | „046 4X1 
LEVEL(5): . 025 5 X 1 


(significance of .03) апа АРС1 (signiZicance o£ .005) are 
seen to be very significant factors. Thais version of the 
covariance model is siagple with fewer terms and iS Shown in 
сите 5.5 . 

Table XV is a listing of the beta coerticients provided 
as an output from tne "ANOVA" progran. The levels ot the 
APC1 variable are seen to contribute positively at the first 
two levels and negatively at the lower three levels as one 
would lcgicaily expect. The APC2 variable also "behaves" in 


a similar fashion rrom level one through level four. 
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TABLE XIV 
ANOVA TABLE 


Reo UUARE = 57] SERIAL AUTOCORRELATION = .017 

SOURCE OF VARIATION DF SIS MS E SIG 
TOTAL 158 Liao m9 
ERROR MG 10.9 209 
MODEL 32 6.4 ‚20 2.34 „0004 
Сі TIME SINCE COLLEGE | · 41 „41 4.79 .030 

X2 COLLEGE RATING 1 212 112 1.43 ‚234 

FACTOR l APCI 4 1.38 33 3.86 . 005 
FACTOR 2 APC2 3 12 E .84 .475 
ГАСТОВ 3 АРСЗ Э „35 -07 no ‚247 
КАСТОК 4 COL. DECREE 6 242 Но 1.79 .106 
FACTOR > REFRESHER | · 00 · 00 О] ‚974 
FACTOR 6 YR GRAD NPS 11 558 293 292 .801 
— “ЖШ 
| | 
| Beene, + 22 Хез. + boxes „Би Key | 
| +PsXes + Во Хес +В Хеу Рес | 
| : | 
| LET, /59 | 


Figure 5.5 Two C/F and Six M/E Model without Interactions. 
Ge THE FOUR COFACTOR AND THREE MAIN  EFFzZCTS MODEL WITH 
INTERACTIONS 


The next model uses the variables time since college, 


college rating, year graduated fron NPS and length of 


retresher as cofactors. It includes APC1, college degree 
and designator as main effects. The noael also evaluates 
the interaction between APC1 and college degree. This 


covariance uodei has a coefficient of multipie determination 
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MAIN EFFECTS 


ОҒ .%466 while the Significance of the model is 
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TABLE 


IV 


BETA COEFFICIENTS 


BETA COEFFICIENTS 


. 026 
. 064 College Rating 
Be. Sk 
АРС] АРС Соае 
E» APCO 
. 149 APC1 
-.007 APC2 
-.070 APC3 
-.424 APC4 
APC2 
. 055 APC0 
.054 APC1 
-.032 АРС2 
-.077 APC3 
APC3 
. 066 АРСО 
. 026 АРС] 
-.072 APC2 
2509 APC3 
-.095 АРСА 
068 АРС5 
COLLEGE DEGREE 
. 148 Business 
200 Engineering 
-.166 Humanities 
. 022 Math | 
-.099 Social Science 
E Naval Science 
REFRESHER YES O 
-.001 сыл Үе<$ 
. 001 Refresher МО 
YEAR GRADUATED NPS 
-.075 1974 
-.151 1975 
.074 1976 
es 1977 
-.048 1978 
MOIS 1979 
„134 1980 
-.040 1981 
. 006 1982 
-.055 1983 
ГОТ 1984 
- 024 1985 


Significant variables were time 


(.008), 


college degree (.027) 
XVI is the ANOVA table from the "ANOVA" 
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Time Since College 


ОВЕ Ка 1005 Analysis 


Since coliege 


„000026. 
(.026), 


and qesignator (- 0043). 


program. 


The 
АРС 1 


fable 


TABLE IVI 
ANOVA TABLE 


R-SQUARE = .47 SERIAL AUTOCORRELATION = -.004 

SOURCE OF VARIATION DF SS MS F SIG 
TOTAL 158 iy 3 105 
ERROR ІШІ» 9.3 209 
MODEL 39 ӘЛ zu 2.06 00003 
XI TIME SDNCESGOBEEGR | 259 5.07 026 
X2 COLLEGE RATING 1 15 Е 1. 9 TUM 
X3 YR GRAD NPS 1 EDD -05 237 545 
X4 LENGTH OF REFRESHER 1 SE „ОИ 521 355 
FACTOR 1 APCl 4 2 ЕЗ “28 3:65 008 
FACTOR 2 COLLEGE DEGREE 6 1.16 -193 2.95 -027 
FACTOR 3 DESIGNATOR 8 1.95 229 3200 004 
INTERACTION 1. 2 17 ЕО ‚06 ый „ЗОВ 


Crce again the interaction term does not appear to be 





Sighiticayt. Тпе particular covariance model is shown in 
Figure 5956: 

| | 
| Yi _ Po + В, Ke, t Êo Xiz + Ву Х: 2 thy Xie „В=Хе= | 
| +P, Хг6 + ё) Х: > r Ва Хез + ё XzpNé2 4568 | 
| | = У oad | 
|o 2502.55 2 0 NA NN 1 


Figure 5.6 4% Cofactor and 3 M/E Model with Interactions. 


Table XVII isa listing of the neta coefficients from 
the "ANCVA" ргодгаз. It can be seen tnat the variable 
length of refresher coutributes  negativeiy to tne overail 
perrormance average. Тһе АРСТ уаглартс ева logica 1d 
in decreasing order čirom the 0 code to the lower APC1 code 
of 4. 
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TABLE XVII 
BETA COEFFICIENTS 











TERM BETA COEFFICIENTS 
COVARIABLES | | 
XT ys 2072 Time Since College 
X (2 . 076 s Ratin 
ТЕ : -005 Year Graduated NPS 
X(4): 22055 Length of Refresher 
CONSTANT: Bo. 
MAITNTEFFECTS 
FACTOR Uns АРСІ АРС Code 
LEVEC ТІНІ» . 798 APC0 
TEST (2): 2262 АРС1 
ВЕЕТ 3): . 024 АРС2 
EVELI 4): =. 063 APC3 
ШЕМУЕЛ 5): -1.021 АРСА 
FACTOR (2): COLLEGE DEGREE 
BENED. 376 Business 
ЕЈ 2): 2129 Engineering 
IB Зз); = Humanities 
LEVEL (4): .016 Math | 
ШКУ ГЫ): -.246 Soclal Science 
CEV EUG): E25] Naval Science | 
LEVEL(7 ): mol Operations Analysis 
FACTOR (3): DESIGNATOR 
БЕМЕН ns n 7 1100 
БЕЛЕ ЕЛ 2) -.041 1110 
ДЕЛЕ (Ба 221-7 1120 
LEVEL (4): ЕНІ.) 1310 
ee : lel.) 1520 
ШЕРЛЕТ (67% 2052 1400 
PEVEL( 7): . 056 1610 
ШЕУ/ЕЪ( Ө): T 3100 
ШЕЛЛЕЛ; (97% о T130 
INTERACTIONS APCl X APC2 INTERACTION 
NUMBER (1): 
ЕЛЕЕ 010): о 1 X 1 
ЈЕЛЕ (2): -.422 22272 
ВЕ. 2.) >> lox 3 
LEVEL (4): 076 ] X4 
evel (>): LES PX 
ДЕБ EIU. -.148 [ЕХ б 
п : „014 “Semi 
PEVELI8): 2.146 DES 
PEVEC 99: „300 2X4 
TEVEC 10): uu) ОГА S 
ЕЕ 22390 ЗХ] 
КЕЛЕГ (12): zb ШАҒА 2 
IESUS) . 020 POE 
ДЕ (2114 ): 1202 3 X 6 
EL IC : .148 4 Xx 1 
ШЕЕ б): 310 4 X 4 
ШЕЕ ЛЕТО В.Д . 334 4 X 5 


Н. STUDY MODEL :THREE MAIN EFFECTS :FOUR COFACTORS :NO 
INTERACTIONS 


The interaction between the variables APC1 and college 


degree was removed and the resulting model is the one 


49 


selected as the study model. Once again the four cofactors 
are time since college, college rating, year jraduated fron 
NPS and length of refresher. Тһе main effects are the zirst 
academic profile code (APC1), college degree and designator. 
The model iS seen in Figure 5.7 . 


о И 


Yi = Bot Bh Хе + Ку + a кб Кг» кх; 
Ку ЖРР -В>Х;- тег 





М 


Lu ee meee 


— 


Figure 5.7 4 Cofactor and 3 M/E Model without Interactions. 


Table XVIII ıs the ANOVA table from the "ANOVA" program. 
The ccefficient of multiple determination is .308 and the 
model nas an extremely hign significance of .00000007. This 
model shows tne Significance of time since college (.015), 
APC1 (.00002), college degree (.032) and designator (.094) 
to all be inportant factors ir explaining the variability in 
rourth quarter qpr's of studerts in the OA curriculun, 

табле XIX is a listing of the beta coefficients from the 
"АЧОЧ А" spr od Gade The cofactors time since college, college 
rating and year graduated from NPS have a positive contribu- 
tion to the fourth quarter qpr while length oc refresher 
contributes negatively. АРС! pehaves in a very logical 
fashicn. The better one's ccllege perzorzuzance reflects a 
more fositive contribution to tne dependent variable (fourth 
quarter GDE). This same variable contributes in a negative 
manner as the college qpr decreases to the lower two levels. 
The ccllege majors of business, engineering, math and opera- 
tions analysis all have a positive beta coefficient while 


the sccial science, humanities and naval science najors have 
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TABLE XVIII 
ANOVA TABLE 


R-SQUARE = .41 SERIAL AUTOCORRELATION = .057 
SOURCE OF VARIATION DF SS MS E SIG 
TOTAL 158 1755 21450) 
ERROR 136 1055 . 08 
MODEL 22 ПЕЛ 152 4.25 . 00000007 
Xl TIME’ SINCE COLLEGE 1 .46 46 6713 2015 
X2 COLLEGE RATING 1 - 20 520) Dd 1102 
55 YR GRAD NPS 1 SUD 02 10 5893 
X4 LENGTH OF REFRESHER à 208 08 08 „298 
—FACTOR 1 АРС] 4 2.24 56 7.43 „000 
FACTOR 2 COLLEGE DEGREE 6 1.08 18 Ze 200 
FACTOR 3 DESIGNATOR 8 П Э 22 2096 .004 
negative coefficients. In this model, all designators 


except £or 1100,1110 and 1130 have a positive beta coeffi- 
cient. Although this model did not have the highest coeffi- 
cient of multiple determinaticn, it is a straightforward, 


Significant model. 





Б 
a 


БЕ 
di 


TABLE III 
BETA COEFFICIENTS 


BETA COEFFICIENMIS 


2025 Time since college 

„085 College Ratin 

. 004 Year Graduated NPS 
EM Length of Refresher 


3.205 
ј АРС1 
т): ON APCO 
2): 211275; АРС] 
у OOU APC2 
УНЕ =, ШІ APC3 
2)1 -.433 APC4 
у: COLLEGE DEGREE 
D ‚ОБЕ Business 
2: Е: Engineering 
э): PS Humanities 
4): „035 Math | 
5): UST Social Science 
ais bl Naval Science | 
I): „141 Operations Analysis 
Mes РЕЗ ТОМАТОВ 
ІШЕ = (05) 1100 
2): -.045 1110 
Bye -218 1120 
4): “TOO 1310 
Э |] 1520 
б): -072 1400 
24: 12219 1610 
8): „148 3100 
20 -.549 1150 


А. CCHCLUSIONS 


The study shows some interesting insights into evalu- 
ating future performance in regards to the Operations 
Analysis curriculum. It would initially seem guite logical 
to assume that the longer an individual has keen out of 
college the harder it would te for kim or her to return and 
succeed in the academic environment. However, this does not 
appear to be the case as reflected by this study. In 
searching for an explanation, motivation could play a major 
cole. Those students who start a curriculum middle to late 
in their military service, have most likely decided to make 
the service a career. They are likely to realize how impor- 
tant successful completion of their chosen subspecialty is 
to their remaining time in the service and are conseguently 
willing and ready to make whatever effort is required to 
accomrlish that goal. More correctly, they are out to do 
the best they can possibly dc while earning their degree. 
This grcuping would also imply that they are most probably 
of an age to have their families and a maturity to be able 
to concentrate their efrorts toward a long term goal. 

In aimost every model tested, the variable for college 
academic performance (APC1) was seen to be a Significant 
factor. Surprisingly, the math (APC2) and technical code 
(APC3) did not prove to be very meaningful in the manner of 
explaining the variability of student performance. Given a 
choice it appears to be more logical to select a student 
based on his performance in his chosen field rather than to 


Strictly choose based on his undergraduate degree. 


The negative contribution of length of refresher prob- 
ably means those individuals who need it most are in fact 
getting the extra quarter or two. This 15 possibly 
confounded by the ability to get an extra quarter or two 
"after the fact", in that, early poor performance can "flag" 
a student and draw attention to him. With liasion between 
the curricuiar officer and the student's detailor, an addi- 
tional guarter or two can get added to his tour at NPS. 

With the possible exception of business majors, there 
are nc surprises in the college degree variable. Those 
students with college majors of math, engineering, opera- 
tions analysis and business in fact nave performed as an 
average better than the humanities and social science 
majors. 

The designator variable was in fact significant to the 
model and showed the designators 1100, 1110 and 1130 to have 
a negative contribution toward fourth quarter academic 
performance. 

The study population covered only those students who 
successfully completed the OA curriculum. Of course one 
would want to infer that the insights gained from the study 
group would apply to the target group or future OA students. 
This can not be done in the strict predictive sense but the 
study can suggest that any selection of future OA students 
be influenced by these results. 

Ihe model preferred by the author is discussed in 
secticn H of Chapter У. This model nas an R? value of .41 
while another model investigated (section EF of Chapter V) 
attains an R2 of -53. The model of section H haS a nuch 
higher level of significance and 1s a simpler less complex 


model. 
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B. RECOMMENDATIONS 


A very interesting study to complement this one would be 
to investigate those Navy students who started but did not 
complete the OA curriculum during the last ten years. The 
study group would not be very large but it could possibly 
provide additional insight into the problen. 

Recent interest has been generated to have all NPS 
Students take the Graduate Record Examination (GRE). 
Currently, this predictor is available for very few individ- 
uals in this study. Exactly when the test will be taken is 
Still to be determined but a study combining academic 
profile codes and the GRE could prove to be much more 
successful in developing а predictive model. In this 
regard, the recommendation that tne APC's and GRE scores be 
maintained by NPS as a permanent part of the student's tran- 
Script is a necessity for future studies of this type. 

Another study of interest would be to determine the 
validity and usefulness of the newly established Technical 
Transition Progran. This new program will require a few 
years before the data can be collected studied but adequate 
records must be maintaired in order to evaluate it in the 


future. 
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АРС 
АРС1 
АРС2 
APC3 
ARE 
GRE 
NMPC 
NPS 
OA 
QPR 


TTP 


APPENDIX A 


ACRONYMS AND ABBREVIATIONS 


Academic 
Academic 
Academic 
Academic 


Academic 


“Graduate 


Profile Code 

Profile Code lst Digit 
Profile Code 2nd Digit 
Profile Code 3rd Digit 
Record Evaluation 


Record Examination 


Naval Military Personnel Command 


Naval Postgraduate School 


Operations Analysis 


Quality Point Rating 


Pearson's Product Moment Correlation Coefficient 


Coefficient of Multiple Determination 


Technical Transition Program 


APPENDIX B 


ACADEMIC RECORD EVALUATION 


Year Grou 
NPS 5040/2 (12-81) р 


зам 1-8 маме 


COLLEGE ( Unaergraduate /Graduate) | DEGREE | MAJOR 


É : E MS B X MN. _ | 


ACADEMIC PROFILE CODE GRE SCORES GMAT SCORES 
ән | wm | me [ v T a | | 


У Q 
ABSTRACT FROM TRANSCRIPT 
NUMBER OF GRADES IN EACH SUBJECT AREA 


SUBJECT AREA 
ШО ++ | жш „__ 


е 70 
MATH — PRE-CALCULUS 
78 77 
CALCULUS 
CARO NO. 2 
POST CALCULUS 


28 
STATISTICS 
42 | 
PHYSICS — LOWER DIVISION | 
48 аб 47 i 48 4 


UPPER DIVISION 
CHEMISTRY 


OTHER PHYSICAL SCIENCE? 


ов 59 79 
AERONAUTICAL/MECHANICAL ENGINEERING EE J 
| 





6 















































n 74 75 78 77 
ELECTRICAL ENGINEERING 
CARO NOQ. J 67 18 19 20 at | 
OTHER ENGINEERING | | 
24 25 2% 27 18 | 
ACCOUNTING | 
21 33 эз 34 38 
ECONOMICS | | 
ж 2% 49 41 42 
BUSINESS AOMIN/MANAGEMENT | | | | 
48 за 48 
HISTORY | 
32 53 | 54 56 | 56 | 
GOVERNMENT/!NTERNATIONAL RELATIONS | | | 
524 59 81 42 63 
| | | 
| 
68 87 79 








*Yereorniogy, Oceanography, Geology 
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APPENDIX C 
THE STUDY O DAD 


Index 

APC1 

APC2 

APC3 

4th QTR QPR 

6th QTR QRAD QPR 

8th QTR Total GRAD ОРЕ 

ВСП ОТВ ТЕ ВВ 

College Rating -- Main Effect 
College Degree 


Social Science 
Neva Science 


S 


«O00 —OYUM CORO I7 
l H H H H M H II H 
I- 

(о 
N 
P 


Time since college (in months) 
Refresher (l = yes, 2 = no) 
College Rating (cofactor) 

Year graduated from NPS 

A selection value 

Length of Refresher (in quarters) 
Time since college (main effect) 
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APPENDIX E 

Welcome to the Anova package. 

This package was developed by Prof. Russell Richards at NPS. Тһе 
latest MORES occurred on May 21, 1985. Please provide your camments 
to Prof. Richards in Root 271. 

Type DESCRIBE for basic documentation. Other instructions are 
obtained ‘by сурто: 

EXTRACTHOW (explains the use of the function extract) 
GLOBAL (lists the global variables in the workspace) 
SYNTAX (shows the syntax for use of several functions) 

In addition, the function called, AOVUTY, provides a menu of 
options which should be somewhat self-explanatory. 

This package is still under development. 

To use the general linear model package for analysis of variance, 
you must first enter your data in the form required. Your need an N X 
l array, Y, containing the observed values of the dependent variables, 
an N X NOOV array, COV. containing the values of the NCOV covariables 
(NCOV may be 0), and an N X NF array, data containing the subscripts of 
the NF factors to be considered in the analysis. Note: The columns of 
data contain subscripts which must be integers l, 2, ..., M where M is 
the number of levels of a factor. You can execute the function called 
RECODE to rewrite the values in data so that they satisfy this 
requirement (simply type RECODE). The function named EXTRACT may be 
useful for creating these arrays if the data can be extracted from a 
larger array which contains the necessary data. Type EXTRACIHON for 


info on the use of extract. If you want to enter the data at the 
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terminal, you can use the function called INPUT. 

After the necessary data are entered into the workspace, 
type RUN O to begin the analysis (the argument O indicates the initial 
run with the given data; for subsequent runs using the same data, enter 
RUN 1). For the first run with a given set of data you will be 
prampted to enter various information needed by the program. This 
information includes names for the factors, covariables, and for the 
job. It also asks if you want to transform the data. If so, the 
original values of the dependent variable are stored in the array OLDY 
and a new Y array is created. 

With the initialization completed, you will be asked to enter the 
interactions desired to be included in the analysis (if any). You 
should enter the interactions by typing a vector containing the numbers 
of the factors which camprise the interactions. For example, if you 
want to include interactions between factors 1 and 2; factors 1 and 3; 
and factors 1, 2, and 3 you should enter the vector 12 13 123. 

The program then performs the following tasks: 

1. A matrix D having N rows and a number of columns which depends 
the number of levels of each of the NF factors is generated. This is 
the portion of the design matrix corresponding to the main effects. It 
contains only the values 0, 2, and -1. The main effects are 
automatically normalized so that the main effects sum to 0. А 
bookkeeping array, DF, of size NF X 2 1s also generated. The elements 
of the ith row of BF indicate which cols of D correspond to the ith 
factor. 


2. An array, DD containing N rows is generated. The number of 


а 


cols of DD depends on the number of interactions and the number ofF 
levels of each interaction. DD is that portion of the overall design 
matrix which corresponds to the interaction terms. Like D, DD contains 
only the values 0, 1, and -l. A scalar, NI, indicating the number of 
interactions iS created, and a bookkeeping array, Bl of size NI X 2 is 
generated. It indicates which cols of DD correspond to which 
interactions. 

3. The overall design matrix X, is generated by catenating COV, 
D, and DD. 

4. The design matrix is checked to see if it is nonsingular. If 
not nonsingular, the rank is determined and a set of cols that can be 
eliminated is indicated. If the design matrix can be made nonsingular 
by elimination of one or more cols fram the interaction set, that is 
done autamatically. If not, program execution terminates. 

5. The analysis of variance is performed on the model, Y = XBETA. 
Output consists of the R-squared statistic, the ANOVA table with the 
covariable effects. The main effects and the interaction effects all 
indicated. For each effect, the degrees of freedam, the sum of 
Squares, the mean square, and an F ratio are presented. The error and 
total sums of squares and degrees of freedom are also given. Finally, 
summary statistics for each of the covariables and for the dependent 
variable for each level of each of the main effects are provided. This 
information consists of the observation counts. The mean, the 
variance, and the standard deviation. The summary statistics are given 
for the original data, not the transformed data. 


6. Available at the conclusion of the run is a GLOBAL vector called 
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BETA which contains the estimates of the parameters included in the 
full model. 

7. After the analysis of variance is performed, various utility 
functions can be performed on the output by executing the function, AOVUTY. 
That function presents a menu of your choices. The function called EXTRACT 
can be used to create the input arrays required by the ANOVA package. 

ТЕ should be used when you already have an array from which all of the 
required data can be extracted. The syntax of the function is: 

EXTRACT DATA 

Where data is a two-dimensional array. 

The EXTRACT function will prampt the user for the information it 
requires. The user must know which columns of data correspond to the 
data that he wants to extract. 

One of the questions asked is the column of the selection variable. 
It 1S assumed that the user wants to select only specific rows of data 
corresponding to values of a selection variable. For example, suppose the 
third column of data contains 1 or 2 with 1 representing males and 2 females. 
If the analysis is to be performed on males only we select those 
observations with a l in column 3. 

The values of the variables in the columns that are used to refer to 
factors must be integers 1, 2, 3, ... etc. that will be used by this 
package as subscripts (factor level indicators). 

After using EXTRACT to create the input data arrays, the user can then 
perform the analysis of variance by typing RUN O. 

The syntax of the major functions in the ANOVA package are: 


EXTRACT ARRAY (Extracts the required data from array) 


04 


RECODE (Operates on the GLOBAL array data) 
INPUT (Creates the arrays needed for run) 
RUN K ШЕШЕ), 1, or 2) 
 AOVUTY GLOBAL (Consists of various useful utility functions) 
This provides a description of the GLOBAL variables used by the ANOVA 
package. The convention used in naming GLOBALvariables is to always 
use underscored names for GLOBAL variables. 
Y - The vector of values of the dependent variable. 
N - The number of observations in Y. 
NCOV - The number of covariables to be considered. 
COV - The array of size N by NCOV containing the values of the NF. 
NF - The number of factors to be considered. 
DATA - The array of size N by NF containing the subscripts of the 
NF factors for each of the N observations. 
D - The design matrix containing N rows of the values 0, 1, and 
-l corresponding to the main effects to be considered in the model. 
The number of cols of D depends on the number of levels of the NF factors. 
A factor having K levels will have K-1 cols in D. K-1 dummy variables will 
be defined with values 0 or 1. The Kth level is defined so that the sum 
of the effects is zero. 
BG - This is an array of size NF by 2 containing bookkeeping info 
concerning which factors correspond to which columns of D. 
DD - This is an array of N rows containing the portion of the overall 
design matrix corresponding to the interactions to be considered. 
It consists entirely of the values 0, 1, and -1. The number of cols of DD 


depends on the factors and interactions considered, 
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